Rapid Approximation of Confidence Intervals for Markov Process Decision Models: Applications in Decision Support Systems
نویسندگان
چکیده
منابع مشابه
Rapid Approximation of Confidence Intervals for Markov Process Decision Models: Applications in Decision Support Systems
Design: Monte Carlo simulation studies of a decision model comparing two treatments for benign prostatic hypertrophy: watchful waiting (WW) and transurethral prostatectomy (TUR). Measurements: The 95% confidence interval (CI) for the mean of the Markov model; the correlation of a linear approximation with the full Markov model; the predictive performance of the approximation; the information in...
متن کاملResearch Paper: Rapid Approximation of Confidence Intervals for Markov Process Decision Models: Applications in Decision Support Systems
OBJECTIVE Develop the methodological foundation for interactive use of Markov process decision models by patients and physicians at the bedside. DESIGN Monte Carlo simulation studies of a decision model comparing two treatments for benign prostatic hypertrophy: watchful waiting (WW) and transurethral prostatectomy (TUR). MEASUREMENTS The 95% confidence interval (CI) for the mean of the Mark...
متن کاملOrdinal Decision Models for Markov Decision Processes
Setting the values of rewards in Markov decision processes (MDP) may be a difficult task. In this paper, we consider two ordinal decision models for MDPs where only an order is known over rewards. The first one, which has been proposed recently in MDPs [23], defines preferences with respect to a reference point. The second model, which can been viewed as the dual approach of the first one, is b...
متن کاملQuantile Markov Decision Process
In this paper, we consider the problem of optimizing the quantiles of the cumulative rewards of Markov Decision Processes (MDP), to which we refers as Quantile Markov Decision Processes (QMDP). Traditionally, the goal of a Markov Decision Process (MDP) is to maximize expected cumulative reward over a defined horizon (possibly to be infinite). In many applications, however, a decision maker may ...
متن کاملReconnguring Distributed Systems Using Markov-decision Models
When reconnguring distributed systems, either because failures and/or repairs have occurred, or because the workload requirements have changed over time, an alternative connguration has to be selected, thereby taking performability and costs, i.e., quality of service, requirements into consideration. In this paper we will present the use of Markov-decision models to decide upon such reconngurat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of the American Medical Informatics Association
سال: 1997
ISSN: 1067-5027,1527-974X
DOI: 10.1136/jamia.1997.0040301